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(54) System and method for wireless capture of encoded data transmitted with a television, video 
or audio signal and subsequent initiation of a transaction using such data 

(57) Adeviqe (110) which can be portable and there- 
fore used in conjunction with several different data 
sources is arranged for wireless capture of encoded 
non-perceptible data directly from a light emitting de- 
vice, such as a television (101) or other video and/or 
audio output device. The data is part of the ordinary pro- 
gram display 6d by the; device (10t)jandyet indiscernible 
by a viewer or listener. The indiscernible data may be 
information needed to order those services or products, 
including prices, delivery Intervals, shying details, 
. coupon^ 
cluda 

arid cdmrnun^pion^ cl&uitry (114 or 118) arranged to 
outpiit at least portions of the data (or data derived from 
the captured data) to a remote agent or device 
(120,121), such as via a telephone call (via 140 or 109 
or 112) or a data transfer to a point of sale device. 



c^D^&fter^^ the device iri- 
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Description 

Field of the Invention 

This invention relates to a device and a method for 
the wireless capture of encoded non-perceptible data 
from a light emitting device such as a television or other 
video and/or audio output device, and subsequent use 
of the captured data to initiate a transaction, such as 
placing a telephone call and transmitting a message to 
a remote agent or automated attendant, or delivering the 
data to a point of sale agent directly or indirectly via a 
telecommunications connection, or to operate another 
device. 

Background of the Invention 

In a copending application entitled "System and 
Method of Capturing Encoded Data Transmitted Over a 
Communications Network in a Video System 1 filed on 
behalf of Isenberg and Tuomenoksa on March 18,1 994, 
Serial No. 08/210802 and assigned to the same assign- 
ee as the present application, it was recognized that 
non-perceptible information can be encoded in a televi- 
sion program, captured in a "set top box 1 , and thereafter 
used to make telephone calls. The set top box is an elec- 
trical device that is "hard-wired" directly in the circuit be- 
tween the video services network and the television set 
(as a stand alone unit or alternatively as part of the tel- 
evision set itself) and thus, unfortunately; is not portable. 
Also, the set top box is dedicated to one particular tele- 
vision (or other video source) and thus cannot be shared 
among several sources. Finally, the user of the set top 
box may be uncertain as to the nature of the information 
captured therein. 

Summary <fl the Invention 



In our invention, a device which 

scan used in conj unction with 

feVwal^iMentSata: sources tl airrarigecJ for wireless 

'i^^^^^^^i tt ^M^A a : t&tevisjpri brother Video 
af^qr audlo output ctevjc^. I^e oSta^s partofthe ordi- 
nary program displayed by the device and yet indiscern- 
ible By a viewer b^lisfener. As an example, a television 

m<§a||r r 

|hd;dfeplayap^ rvicesancT 
pr^ctSi^ne inc$scer^ be^lhformation 
" neefle^tb Wa%r those services or products, inditing 
prices', delivery intervals, shipping details, coupon of- 
fers, and so-oh. 

Capture can be effected by decoding subltminally 
modulated video broadcast signals, in a manner sug- 
gested in U. S. Patent 4,807,031, issued on February 
21, 1989. to R. S, Broughton, et al., the teachings of 
which are incorporated herein by reference. Alternative- 
ly, a modulated carrier, which, for example, can be an 
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amplitude shift keyed (ASK) or frequency shift keyed 
(FSK) signal having its primary frequency components 
at a frequency (e.g. 25 kHz) not usually present in a con- 
ventional television signal, can be added only to the lu- 
minance component of a television signal, and the data 
can thereafter be captured using bandpass filtering and 
an ASK or FSK receiver. After capture, the device in- 
cludes a memory arranged to store the data for later use, 
and communications circuitry arranged to output at least 
portions of the data (or data derived from the captured 
data) to a remote agent or device, such as via a tele- 
phone call or a data transfer to a point of sale device. 

In accordance with the present invention, the en- 
coded non-perceptible data includes associated dialing, 
routing, or identification information, so that other por- 
tions of the captured data can be transmitted to an ap- 
propriate final destination or device. In this context, the 
final destination can be (a) a remote location, such as a 
platform arranged to process and consummate transac- 
tions, or (b) a point of sale system or other device (e.g., 
TV, stereo, VCR Plus, smart mouse device, etc.). The 
other portions of the captured data that constitutes a 
payload to be communicated to the final destination or 
device, can, for example, be product or coupon informa- 
tion that is related to the display from which the non- 
perceptible data was captured, or programming or con- 
trol data. 

Further in accordance with the present invention, 
the capture device includes a built-in display, such as 
, an LCD display, and the encoded non-perceptible data 
includes display information, so that at least portions of 
the captured data can be discerned by a user of the de- 
vice, and the user can thus be kept informed as to the 
operation of the device. The memory and the commu- 
nications circuitry in the capture device are advanta- 
geously arranged so that, in a transaction initiated by 
the device uslngi^p^red^ 

may be initiated between the user and an agent at a re- 
mote terminal or. a F^S eystertv anc* Information may 
tfetranfmitttd %p. ; bM$&}&i inf'tte^dev^^r>l^/rfe 
tfleval: ' 1 * ^ " - ■ ^-.^ ^ ' '< 

: Sria '* "V : " ^ 

.. , ._.. r .. v ..,.. -.^^r ?. ■■■Qf-^r- 

Theipresent invention will be more fully appreciated 
by conside ration of the following Da^ied^ Description, 

whichjgrip^ 
! irio irij 
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H^St Is M K W^^^4xi^^:^ r ^m Mb^in1§rit 

of I system arranged in acbc^rc^ce wtfh tlie 

present invention for wireless capture of encoded 

data transmitted with a television signal; 

Fig. 2 is a block diagram Illustrating the components 

of capture device 110 of Fig. 1 ; 

Fig. 3 is a diagram illustrating the format of captured 

data; and 

Fig. 4 is a flow diagram of the process by which data 
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embedded in a subliminal visual or non-audible 
message is captured and used. 

Detailed Description 

5 

Referring first to Fig. 1, there is shown a schematic 
drawing of one embodiment of the present invention ar- 
ranged for the wireless capture of encoded non-percep- 
tible data from a light emitting device such as television 
101 , and subsequent use of the captured data to initiate 10 
a transaction which might be handled by a person at an - 
agent terminal 1 20, or a person at another terminal 1 21 
that is supported by an interactive service platform 130. 

A television signal Is received by television 101 via 
over-the-air transmission, as from transmission tower is 
102 via a transmission link 103, or alternatively is sup- 
plied by a cable TV connection, or from a VCR/video- 
tape. The video portion of the television signal is dis- , 
played on the picture tube or other visual display area 
105 of a monitor, computer or a television 101, while the so 
audio portion of the television signal is played through 
or by projected from speaker 106. Associated with the 
program that is seen and/or heard by a viewer/listener 
is non-discernible encoded data that is transmitted as 
part of the audio and/or video signal. For example, the 
program may be an advertisement for a service or prod- 
uct, and the indiscernible data may create a subliminal 
visual pattern on the visual display area, that when prop- 
erly received and decoded, contains information need- 
ed to order those services or products, Including prices, 30 
delivery intervals, shipping details, coupon offers, and 
so-on. 

Encoding, transmission and decoding of non-dis- 
cernible data may be accomplished as described in a 
patent application entitled "System and Method for En- as 
coding Digital Information in a Television Signal" filed on 
behalf of f. Sizer and assigned to the same assignee as 
the present application, which co-pending application is 
incorporated herein by reference. Briefly, it was found 
Msirjg a^spedrum analyzer on a typical video signal, that <o 
^^^■^^^^iB^l^ax^ fre^uency^ 

that between tireste frequencies', there are other fre- 
quency bands in which little information is carried. One 
such frequency band is between 1 5 and 30 kHz. By add- 46 
ing a low level carrier signal or tone at a frequency in 
tftisfcand, eay ^kH^ is ript degraded, 

b^ta pr^erly ^n^d^coder caryre'ceive ;: aM decode 
trie enoocje^ 

cah'be suW a video signal-by acBirig *6 

to thfe video signal an amplitude shift keyed (ASK) or 
frequency shift keyed (FSK) carrier signal, and the dig- 
ital information can later be recovered using ASK or FSK 
decoding. Encoded data can also be inserted in a tele- 
vision signal and recovered by a receiver that responds 65 
to the picture displayed on the television, in the manner 
described in patent 4,807,031 cited above. 

The program displayed on television 101 Is sensed 



by a portable capture device 110, which Is described in 
more detail in connection with Fig. 2. When the non-dis- 
cernible encoded data is part of the video signal, such 
sensing takes the form of light from display area 105 
being collected by an optical lens 117, while when the 
non-discernible encoded data is part of the audio signal, 
such sensing takes the form of sound from speaker 106 
being collected by a microphone (21 1 in Fig. 2). In either 
event, there is a wireless communication of the informa- 
tion from television 101 to capture device 110 such that 
the encoded data is "viewed" or "heard" rather than be- 
ing transmitted through a wired connection, or through 
a more conventional radio frequency communication. 

In addition to receiving non-discernible encoded da- 
ta, capture device 110 has the capability of (a) storing 
the encoded data, (b) transmitting (or otherwise output- 
ting) the encoded data (or information retrieved using 
such data) to a remote location or device, and (c) dis- 
playing the encoded data to a user. The data may in- 
clude information for initiating a transaction or originat- 
ing a telephone call, as well as additional information (e. 
g., price and ordering information) associated with the 
television program being displayed on television 101. 
The remote location may be agent terminals 1 20 or 1 21 , 
interactive service platform 130, or a point of sale sys- 
tem, and the communication between the capture de- 
vice 110 and the remote location may be one-way or 
two-way. 

In the case where encoded data is to be output from 
capture device 11 0 via a telephone call, the call may be 
initiated and transacted in one of several ways, as Illus- 
trated in Fig. 1 . First, the data may be transmitted over 
a wireless link to an associated telephone base station 
109 that is, in turn, connected to a telephone fine 111 
that is part of a telecommunications network 115. Com- 
munication between capture device 110 and base sta- 
tidn 109 may be •^imj^tshfiQl : ;!h a variety # ways; as 
an example, the same signaling and tranemissiqn can 
be ueed.ae is pre^^tlyiused in ^ 
acdrdie|s te[1^|^i^r^ .'^iTh^ii^^^ . as^^^^^^jb'af e) 




ture device 110 may inc^jde thetuhc^ 
telephone, so that the data may b^.cpnmunicated to a 
remote location via ^ wire less citl J3^;ed to a mobile 
telephone tgwitcjltfo^ 
. c&nrj^ej^^^ 



cipturfc ' 
quency (DTMF) transceiver attar^ed'to gSfi&rate a se- 
ries of audible tones. Accordingly, a fourth way to initiate 
a telephone call would apply portions of the data to the 
transmitter (tone generator) portion of the DTMF trans- 
ceiver. Capture device 110 may then be placed in juxta- 
position with the microphone portion of a conventional 
telephone handset, such that the audible tones gener- 
ated in capture device 110 are acoustically coupled 
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through the handset to receivers in telecommunications 
network 115. 

Capture device 110 can also output encoded data 
directly, without making a telephone call. This is useful 
in conjunction with a point of sale system or the like, 
which includes a docking station or other interface to 
which the capture device may be connected, or an IR 
receiving device or a device responding to DTMF. 

If an outgoing telephone call is initiated by capture 
device 110, the call can illustratively be routed through 
telecommunications network 115 directly to an agent 
terminal 1 20, or to an interactive service platform 1 30 to 
which is connected another agent terminal 121. When 
a connection Is completed to platform 1 30, the call may 
be routed by a switch matrix 131 to a voice response 
unit 132 that operates under the control of a processor 
134. Information included in the captured encoded data 
can be provided to the attendants, or processor 1 34 can 
' perform a look-up and retrieval operation in database 
1 31 , using encoded data as a key, in order to effectuate 
a desired transaction. 

For certain transactions, information connected 
with a transaction may also be transmitted from service 
platform 1 30 to capture device 1 1 0, either for display to 
a user, storage for later use, or output to a point of sale 
system or device. This information may, for example, be 
confirmation information, indicating that a transaction 
has been effected, or details regarding a just completed 
transaction, such as ticket information relating to a travel 
reservation. 

Referring now to Fig. 2, there is shown a block dia- 
gram illustrating in more detail the components in one 
embodiment of capture device 110 of Fig. 1. If the en- 
coded non-perceptible data is inserted in the video por- 
tion of a television signal, the images displayed on visual 
display area 105 are captured by optical lens 117 and 
an assockted.phbtpdetectbr 203, which is arranged to 
supply an electrical, signal to fitter/receiver 215 repre- 
sehting ; the image. On the other hand, if the encoded 
non-p^fceptfbie dat| is inserted in the audio portion of 
a^efevisidn signal, the putput f ipm spegker 106;l| jcap- 
turddby a^c^^c^e^3l^ari|^ ass^iatedaj^jplifter 
213, which is #rr|hged t6 supply an electrical signal to 
filter/receiver 215 representing the sound energy. In ei- 
ther event, the encoded non-perceptible data te decod- 
ed in filter/receiver 21 i5 in a^manner consistent with the 
njtoiej in vyhieh the^orjginll data; yy^ -encoded. Thus, 
fitter/receiver 2i5 can.be arranged to ; perform tri&same 
functionality as the ele^ of the 

above referenced i Broughtbh et al. patent, or, alterna- 
tivelyi the operation of filter/receiver 2 15 can be as de- 
scribed in conjunction with Figs. 4 or 7 in copending ap* 
plication of T.Sizer. In each instance, it is noted that cap- 
ture device 110 receives and recovers encoded data by 
"watching" or 'listening to" the output of television 101 
(or another similar display device), and that the capture 
device 1 1 0 Is not connected to television 1 01 or the other 
display device by a cable or wires. 
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The output of filter/receiver 215, representing the 
data captured by capture device 110, Is applied to a mi- 
croprocessor 220, which is arranged to perform various 
data processing and control functions in coordination 
with programs stored in an associated memory 221 as 
well as inputs received from a user of capture device 
110. Generally speaking, capture device 110 may oper- 
ate in an active or a passive mode. In the active mode, 
capture device 110 responds only to user initiated cap- 
ture commands. In the passive mode, capture device 
1 1 0 captures all of the data sent to it while in that mode. 
In either mode, captured data may be routed by micro- 
processor to memory 221 and stored for use at a later 
time, as determined by the user. The captured data may 
also be displayed on a display 225, such as a liquid crys- 
tal display, so that a user will be aware of exactly what 
informatbn was captured. 

The control programs contained in memory 221 can 
implement numerous functions, which, broadly speak- 
ing, can be categorized as (a) functions relating to data 
capture, such as SAVE and AUTOSAVE functions, (b) 
functions relating to output of already captured data, 
such as DIAL and SEND DATA functions, (c) functions 
relating to memory manipulation, such as the RECALL 
and DELETE functions. The above enumerated func- 
tions are initiated when respective buttons 241 - 246 are 
activated, and the activation signal output from a button 
is applied to microprocessor 220 via a button interface 
240. Each of the functions is discussed below. 

When the SAVE function Is Initiated by activation of 
button 241, capture device 110 is In the active mode, 
and the encoded data contained in the current audio or 
video output of television 101 is captured. This is ac- 
complished, for example, by activating optical lens 117 
and photo detector 203, or microphone 21 1 and ampli- 
fier 213, for a relatively brief period of time, typically on 
the order of several^ecc^c^r^^ that encxx^i data as- 
sociated whh the current program being displayed on 



221. A. vls^^auc^lcue r||^|^Ma*^^. 



de^oe^tmefe^ citato 
function is activated, micropro^e^ 220 may Be ar- 
ranged to control display 225 so as to indicate the cur- 
rent status, e.g., that the ra^ 

' ih1^a&;%bih^^ 

th&t had theretofdr been subliminal art& M 

The display can also indicate that the device is •aimed" 

correctly. 

When the AUTOSAVE function is Initiated by acti- 
vation of button 244, capture device 1 1 0 is in the passive 
mode. In this mode, capture device 110 captures a se- 
ries of encoded data that may be contained in each of 
a series of programs that can be viewed/heard on tele- 
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vision 101. This is accomplished, for example, by acti- 
vating optical Ien9 117 and photo detector 203, or mi- 
crophone 21 1 and amplifier 21 3 t for a relatively long pe- 
riod of time, typically on the order of several minutes or 
hours. Encoded data captured from the various pro- 
grams being displayed on display area 105 or played 
through loudspeaker 106 over a long period or time are 
processed by fitter/receiver 215 and stored in memory 
221. As with the SAVE function, when the AUTOSAVE 
function is activated, microprocessor 220 may be ar- 
ranged to control display 225 so as to indicate the cur- 
rent status, e.g., that the capture device is in the process 
of receiving and capturing data. 

When a user of capture device 110 desires to use 
any of the data stored in memory 221, including data 
stored a result of the AUTOSAVE function, the contents 
of memory 221 may be retrieved and displayed on dis- 
play 225 by initiating the RECALL function upon activat- 
ing button 245. This permits a user to be aware of ex- 
actly what information was previously captured and 
stored Through this function, the user will be able to 
selectively peruse or scroll through the stored data, so 
as to retain or use selected portions thereof. Activation 
of button 246 initiates the DELETE function, whereby 
portions of the data stored in memory 221 are selectively 
erased. In order to conserve and thereby "recycle - to 
storage capacity ol memory 221, microprocessor 220 
may also be arranged to manage the contents in mem- 
ory 221, so that the oldest Information stored therein 
could be cycled out and deleted as new information is 
captured and stored. 

Turning now to consideration of the use of already 
captured data, it is an important functionality of capture 
device 1 1 0 to permit such data to be output upon a com- 
mand from a user. Such data, when output, can be used 
to (a)jnake a telephone call, and, when the call is an- 
swered, to provide information to a live or automated 
attendant that receives the call, or (b) initiate a transac- 
tip%££<^ a specieJ^ur|qse terr 

m^iriSl ol^ibsk arranged to receive tne ^oied W$ t or a 




teffphohi cancan be MB^^^M^j&^/u.^ 

First, ceptured data-cah &e routed by ^microproces- 
sor 220 from memory 221 to a mddem 246 and then to 
a bkse station interface 250, so that the information can 
be&cfemuriteafedio^ 1. -ThiSv 

fnku^ 

naf^:|^ !:'>.. 

'^'^^^jSapAiribd datavcah be rdutef through moi 
derrv 2%B to a Wire interface 253, which allows capture 
device 110 to be physically connected to a terminal or 
docking station for Information off loading. 

Third, captured data can be routed to a DTMF trans- 
ceiver 247, which includes a tone generator arranged to 
output DTMF tones. These tones can be directly con- 
nected to a telephone line 1 1 2 via a standard connection 
such as RT1 1 jack 114. Alternatively, capture device 110 
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can be placed in juxtaposition with the microphone in a 
telephone handset, and the audible tones can be ap- 
plied and used much like an audible frequency autodi- 
aler. 

Fourth, capturBd data can be routed through mo- 
dem 246 to a cellular telephone 252, which can initiate 
a cellular call. When a cellular connection is completed, 
the captured data can be output in encoded form or as 
audible tones. 

For each of the arrangements just described, a tel- 
ephone call may be originated using the DIAL function. 
This function is initiated by activation of button 242. With 
this function, dialing or routing information, which is part 
of the data captured by capture device 110 and now 
stored, in memory 221 , is retrieved. This information is 
then further processed, so that a telephone call can be 
initiated. In some instances, a call is originated by ap- 
plication of stored.data to DTMF transceiver 247, so that 
audible tones can be output. In other instances, a data 
call can be initiated by appropriately formatting stored 
data. In yet other instances, such as when a cellular call 
is dialed, stored dialing information may be applied to 
an outgoing number register. The exact manner in which 
information is output from capture device 110 can vary, 
in accordance with several embodiments of the present 
invention. 

While the DIAL function is used to output certain 
captured information needed to Initiate a telephone call 
(or other data output function), the SEND DATA function, 
initiated by activation of button 243, is used to output 
other portions ot the captured data stored In memory 
221, pertaining, for example, to a transaction that the 
user desires to make. This additional data is retrieved 
from memory 221 and appropriately transmitted, de- 
pending upon the manner and type of telephone call in- 
volved. Thus, data may be output either via base statipri 
interfteeiSO to jJ^^tt^^ ^;0^v,or yij9Sli|J^ jack 
1 1 4 onto telephone line 112, or via cellular phone 252 



a. *o 
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infdmpioB to 



matron being outp^ rmy ? 
22& This alldW a person 
Identify the Information that was captured, and use the 

inf^matibrVfn a&a^ 



^o^trMlnw^ 
mp\ipdM\ display 
the capture device to. 




so ^^^^mw^mi 

235 is tb ailbw cajjfiJreii'ffita to b| output directly to a 
device such as a point of sale system or a VCR or the 
like, via infrared transmission. The purpose of speech 
recognition circuit 246 is to convert captured data to spo- 
ss ken phrases, which can be played to a user or to an at- 
tendant after a telephone call is initiated. The purpose 
of handset 230 and keypad 247 is to allow capture de- 
vice 110, In addition to being used in accordance with 
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the present invention, to be used to complete conven- 
tional dialed telephone calls. 

In one application of the present invention, a tele- 
vised advertisement for a product includes additional or- 
dering or "coupon* information embedded in a sublimi- 
nal visual pattern within the video image displayed on 
visual display area 105. The coupon information de- 
scribes the item(s) offered for sale, the regular price, the 
coupon value, and contains additional information need- 
ed for ordering. This embedded information is transmit- 
ted between television 1 01 and capture device 4-1 0 at a 
rate such as 60 bits per second, that is sufficient such 
that the necessary information can be transmitted in a 
very brief period of time. In the application just de- 
scribed, the embedded product information, dialing 
number, coupon Information and necessary checkbits 
together comprise approximately 2,000 bits of informa- 
tion, so that between three and four seconds would be 
required for transmission. Once the coupon information 
is stored in capture device 110, the user of the capture 
device can supplement the coupon information with 
user entered data which can be entered using keypad 
247. This supplemental information may include credit 
card or other billing information pertaining to the user, 
as an example. 

As 6hown in Fig. 3, the information represented by 
the encoded data can be organized in severalfields. Us- 
ing the coupon application as an example, a first field 
301 contains a telephone number which may be used 
to originate a telephone call in order to order the product 
to which the coupon applies. Illustratively, this will be a 
toll-free or •800" number. Other information associated 
with the coupon can include a product description in field 
303, an expiration date In field 305, the time that the 
advertisement was televised infield 307, the number of 
the television channel running the ad in field 309, and a 
serial number for the ad in field 311 , identifying eitljer or 
both the, particular ad and its sequence in an ad cam- 
paign. It is to be not(?d th^tyaripiis other Informalion can 
also be inclticfed in ["the #ifc^rna|i^ iBustrated in Fig. 3, 
eii#h al1%i^ords or attribute ^ 

pf^uctisa^ilabife 

words would be useful in retrieving from memory 221, 
information relating to specific products or advertisers. 
THe process by which information embedded- in a 



tfc^eCpre^ operation are, 

cor^mpite^ riM li| 

mode, both of which follow a "start" step 401 . 

In the passive mode, a user desires to operate cap- 
ture device 1 1 0 in an unattended manner, and to capture 
all of the encoded data that may be subliminally dis- 
played on a display device 105 or output from speaker 
1 06 over a relatively long period of time, typically several 
minutes or hours, until the user, at some later time, de- 
sires to discontinue or terminate the capture. This mode 
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is initiated using AUTOSAVE functionality, by activating 
button 244. When this is done, a positive response is 
obtained in step 502, so that data capture, storage and 
display, all as described below in connection with step 
507, occur. While in the passive mode, capture is termi- 
nated by subsequent activation of the same button 224. 

In the active mode, a user operates capture device 
110 in real time, typically while viewing a video display 
or listening to an audio presentation. During the display 
or presentation, the user sees or hears a corresponding 
televised advertisement or other indication that imper- 
ceptible information is available for capture. The user 
may, at this time, be instructed to activate SAVE button 
241, or the user may know, from previous experience, 
how to use the device. When button 241 is activated, a 

. positive result occurs in step 503, thereby capturing the 
imperceptible encoded data, displaying all or a portion 

. of the data on display 225, and storing same in memory 
221, all in step 5C?7 Until the SAVE button is activated, 
capture device 110 may be in a "wait state" 505. 

The user of capture device 110 determines that the 
appropriate data has been captured by reviewing the in- 
formation seen in display 225. After the captured data 
has been reviewed and determined to be correct, acti- 
vation of the DIAL button 242 on the portable capture 
device 1 1 0 in step 509 initiates step 51 3, by which stored 
dialing and/or routing information, illustratively in field 
401 of Fig. 4, Is recalled from memory 221 . A call is then 
originated launched, such by transmitting the dialing in- 
formation from memory 221 through base station Inter- 
face 250 to base station 109 and thence to telephone 
line 111 and telecommunications network 115 to inter- 
active service platform 1 30. The call may be a local or 
long distance call, made using a "plain old telephone 
service 1 (POTS) line; alternatively, a toll-free, cartl may 
be launched using 8ii BOX) number. Desirably; automatic 
number identify cati|r1D. a^d 

available in the netwoft may be 

usedt^bfWdeac^ 
Inaddmontothe^ 



l^i§'m«Be1(h^l® 




Serine cairr^^ejE^ori^ 
45 is made in step SJS that the call h^been^swer^ #nd 
thatthe SEND DATA bUto 2^3 hM b^en pushed; (Until 




55 



519. As stated preViSi^ 

called party, the information received iricludes details 
concerning the advertised product, the identity of the 
caller, and other information associated with the item 
that was initially displayed or mentioned on the televi- 
sion program. Advantageously, the advertiser will know 
more about their customer than ever before. This Is be- 
cause the advertiser will be able to determine from the 
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transmitted Information which advertisement drew the 
business, how long it took the caller to respond to the 
ad. and the geographic location of the callers, based 
upon AN I or caller ID. It will be easy to tell which ads in 
a campaign are most successful 

In accordance with one optional arrangement of the 
present invention, when data is captured and stored in 
step 507, the newly collected data is compared with pre- 
viously stored data. When a match is found, any dupli- 
cate data is dropped. In addition, the information in var- 
ious fields is examined, to assure that the data captured 
is in the appropriate format If an error is detected in any 
data, the information may be deleted, and "new" data 
collected. This is accomplished by repeating capture 
step 507 several times. 

In another application of the present invention, an 
interactive television capability is provided in connection 
with a game show or television drama For a game show,, 
an audience would be asked to vote on various aspects 
of the game. This could include questions such as which 
person should go on a date with the contestant, or which 
singer is the best? The audience would be instructed to 
press the 'SAVE 1 button on their capture device at the 
appropriate time specified for their choice. The viewers 
vole would then be cast by depressing the DIAL button, 
communicating with the game show host, and then 
transmitting information indicating the vote by depress- 
ing the SEND DATA button. Alternately, one number 
could be transmitted and an automated interactive voice 
platform such as the InfoWorx™ platform available from 
AT&T could offer options to the caller. These calls could 
be toll free calls, or, alternatively, billed to the caller. 

In yet another application of the present invention, 
a video on demand capability can be provided. A viewer 
sees a video he or she would like to see advertised on 
a previewing network. An instruction to press the DIAL 
button on the capture devicjefeis ^ made on the previewing 
channel to indicate to the viewer that he or she can press 
th%button to order-a particular;video. Thecaltwquld be 
placed t4a voiceli^^ 

video orVd^ Sbput wHicfi^a^^e 



e^^^^t^ia : £S feseht pyer the phom^ 
the callis cbrlrtec^ to 
acknowledge the order and select a time slot. 

The present invention can also be employed in the 
context of prograrTiming ol a VORi particularly i where the 
*useralready^ VC%Pius, 



ing a particular television show constitutes the informa- 
tion^ included in a televised advertisement. When the ad 
is viewed, the viewer can press the SAVE button and 
send the sequences to the VCR Plus using IR transmit- 
ter 235. 

While the portability of capture device 11 0 is advan- 
tageous, it is to be noted that In some arrangements, 
the functions of capture device 1 1 0 and telephone base 
109 may be combined in a single stationary unit, which 



10 



75 



SO 



25 



30 
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might resemble a cordless telephone base station. In 
this event, the functionality of capture device 110 would 
be included In the stationary unit, and that unit would be 
arranged, in the manner previously described, to collect 
information from the visual display area 105 and to pro- 
vide storage of the collected information. In this arrange- 
ment the stationary unit could also be adapted to utilize 
input devices such as optical character recognition 
(OCR) or scanners that would provide an additional 
method of inputting telephone numbers and coupon 
and/or produot information. The hand piece of this sta- 
tionary unit would be used to place a call and send the 
data. 

The present invention is not limited to live televised 
programs, but can also be operated in conjunction with 
stored video programs played from a VCR. In this ar- 
rangement, advertisements and other encoded informa- 
tion is included in videos at the time they are recorded 
or at the time they are mastered and put onto video cas- 
settes. A viewer watching a video with such an ad can 
respond immediately to reserve another video, pur- 
chase one of the items advertised, or order catalogs au- 
tomatically. When a program containing subliminairy en- 
coded data is viewed, the viewer simply presses the 
DIAL button, launching a telephone call, and then press- 
es the SEND DATA button, sending captured data, such 
as product information, to an agent, who can verify the 
order using the additional Information that was captured 
or stored in the device. 

The portability of the present invention can be used 
to advantage In implementing what can, in effect, be 
called a "Roaming Bulletin Board". A user can be attend- 
ing a conference or traveling through the airport where 
kiosks or bulletin boards are set up. In the case of a con- 
ference, an atteno&e would walk through the conference 
viewing the displays. When the attendee sees a display 
of interest, h^or^p^ 

the display, and captures the nph-disc^rnijb|e enccfaed 
dataftorf* eithW tr^^ 
put ;(iftt& theiseV^ 

it WfurBief tf§e ndteci 
can be used in the context of 
telephones. When .a'fcapture ^^m^kM^m^^ With 




r 

ducwM free^or coriventfoha 1 



did i 



originating^ 

The call may be placed to ah interactive service plat- 
form, and additional captured data, such as coupon or 
similar information, can then be used to effectuate a 
transaction. 

Various modifications and adaptations of the 
present invention will be apparent to those skilled in the 
art. For example, the functions provided by the present 
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Invention may be combined with those used In a per- 
sonal digital assistant (PDA) or a laptop computer. If de- 
sired, a simultaneous voice and data (SVD) modem of 
the type available now from AT&T could be provided in 
capture device 110 to allow communication both by 
voice and data transfer, at the same time. Various func- 
tions can also be added to the processes and applica- 
tions described. For example, telephone base 109 may 
be programmed to dial a number or series of numbers 
at specific times, when certain amounts of information 
or data have been collected, or based upon some crite- 
ria. Capture device 110 could then send collected infor- 
mation "in bulk" to interactive service platform 130. For 
this purpose, modem 246 could be used, so as to send 
the information more efficiently. 



Claims 

t. Apparatus for initiating a transaction, comprising 

means arranged for wireless capture of data 
directly from an audio/visual display, said data 
being indiscernible by a viewer or listener, and 
means arranged to transfer at least portions of 
said data to a separate transaction processor 
to initiate said transaction. 

2. The invention defined in claim 1 wherein said data 
includes dialing information for originating a tele- 
phone call, and wherein said transfer means 
includes means for initiating said telephone call 
using said dialing information. 



10 



is 



20 



25 



30 



shift keyed (ASK) or frequency shift keyed (FSK) 
carrier signal added to a television signal, and 
wherein capture Is effected by detecting and decod- 
ing said carrier signal. 

7. A system for capturing data comprising 

means for wireless capture of indiscernible 
data embedded in an audio/video display; and 
means for outputting at least portions of said 
captured indiscernible data to a remote device 
via a telephone call. 

8. Apparatus for initiating a transaction relating to a 
program appearing on a television display, said 
apparatus comprising 

means arranged for wireless capture of data 
directly Worn said television display, said data 
being indiscernible to a viewer of said television 
display; 

means responsive to said captured data for 
obtaining a telephone number, said telephone 
number being associated with a remote loca- 
tion arranged to perform transactions associ- 
ated with said program appearing on said tele- 
vision display; 

means for initiating a telephone call using said 
telephone number; and 
means for transmitting to said remote location, 
during said telephone call, additional Informa- 
tion contained In said captured data, said addi- 
tional information also pertaining to said pro- 
gram. 



3. The invention defined in claim 1 wherein said appa- 
ratus further includes 

means responsive to said capture means for 
storing said data, and 

wherein said traMeT means includes means 
tor ;c|o|^|^^^ said storing 

means ^reatiyjtb 1 separate transkctaw^ 
essof. 

4. The invention defined in claim 1 wherein said cap* 
ture means is in a portable capture device and said 
transfer; means is in a base station, and wherein 

\ \ rWa Jito device 



as 



9. 



40. 



46 



A system for responding to a televised: advertise- 
ment, cdm^sjng 

means for emjiec^ng ndn \ttfpvma~ 
: lng^ 




ring ihformatiph 1 
to said base station. 



so 



The invention defined in claim 1 wherein said 
audio/visual display includes non-perceptible 
encoded data, and wherein said capture means is 
arranged to receive and decode said encoded data 55 

The invention defined in claim 5 wherein said non- 
perceptible encoded data includes an amplitude 



■ other infblm;^ 
played in said advertisement; 
means arr^ngad for wiraless capturf ; of said 

feMaVlF^^ 



phone riMbVario^ 
information to said remote processor via said 
telephone call. 

1 0. A method for Initiating a transaction, comprising the 
steps of 

capturing data directly from an audio/visual dis- 
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play, said data being indiscernible by a viewer 
or listener, and 

transferring at least portions of said data to a 
separate transaction processor to initiate said 
transaction. 5 

11. The method defined in claim 10 wherein said data 
includes dialing information for originating a tele- 
phone call, and wherein said transferring step 
includes initiating said telephone call using said 10 
dialing information. 

12. A method for capturing data comprising 

capturing, using wireless capture, indiscernible 15 
data embedded in an audio/video display; and 
outputling at least portions of said captured 

indiscernible data to a remote device via a tek. * ■• * 

ephone call. 

20 

13. A method for initiating atransactton relating to apro- 
gram appearing on a television display, said method 
comprising steps of 

using wireless capture data directly from said 2s 
television display, said data being indiscernible 
to a viewer of said television display; 
responsive to said captured data, obtaining a 
telephone number, said telephone number 
being associated with a remote location & 
arranged to perform transactions associated 
with said program appearing on said television 
display; 

initiating a telephone call using said telephone 
number; and 35 
transmitting to said remote location, during said 
teleprWrte call, additional information con* 
tained in, said captured data, said additional 
Jhfdrrnatibn also pertaining to,^ — 
^ . \v .' 40 

14 Am|fo^ ..; "■').■:: :( l ... ~ : c's- . - -1 

v %en|;:^ steps of /.V'V. T 7. ;\ -. . ,7 V : * V : t ■• * ■ ' .- i I;:, ■ 

embeo^ih^ non-discerniW 

aoVertisement, said information including (a) a ** 

telephone number for a remote processor 

. ^■.-arfang^^tbj.proGe^s^ordeiB fpT^e^items^dis^ . . * ; -\ y , u - • A - -■ : -^p-'^yr- : -v^^v 

;;;; |«t^ .;<r \ ^ yfrz ^m^^ ' 

iriforf^ \ f ; ; ^ 

s^ldvertisem^t "* ^ 

capturing, using wireless capture, saidnon-dis- 
cemible information directly from said televised 
advertisement; and 

responsive to said captured information, (a) 
placing a telephone call using said telephone ss 
number and (b) transmitting said other informa- 
tion to said remote processor via said tele- 
phone call. 
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